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DETAILED ACTION 
Response to Arguments 

1. Applicant's arguments with respect to claims 1-18, 30, 36-38 and 40-45 have been 
considered but are moot in view of the new ground(s) of rejection. 

2. Applicant's arguments filed 12/21/06 have been fully considered but they are not 
persuasive. 

(a) Applicant argues "However, Kuzma fails to disclose or suggest the elements of a 
timeline data structure specifying a particular order for delivering each of a trigger, 
announcement and package data structures to a receiver, wherein the enhanced 
programming content includes the trigger data structure, announcement data structure, 
package data structure and timeline data structure..." on page 10, 2 nd paragraph of the 
Remarks filed 12/21/06. 

In response to applicant's arguments against the references individually, one 
cannot show nonobviousness by attacking references individually where the rejections 
are based on combinations of references. See In re Keller, 642 F.2d 413, 208 
USPQ 871 (CCPA 1981); In re Merck & Co., 800 F.2d 1091, 231 USPQ 375 (Fed. Cir. 
1986). 

Carr was brought in to teach a trigger, announcement and package data 
structure. Kuzma was brought in to teach a timeline data structure specifying specific 
times defined relative to a specific start time of inserting content. Referring to Fig. 4, 
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Kuzma clearly teaches the aforementioned. "The information about the television 
programs or web pages include a name, source, description, and a time stamp of the 
programs or web pages. The script 400 also contains an entry 450 indicating when, 
during a national broadcast, local programming such as a local television show or a 
local advertisement may be inserted" - col. 5, line 65 - col. 6, line 4. "The time stamp 
- provides a time reference as to when the program or web page is to be broadcasted. A 
local affiliate may use the time stamp to determine when it may insert local 
programming... A local network may also use the timestamp to determine when it may 
insert its own web pages into the existing national programming or into space allocated 
for local programming" - col. 6, lines 26-34. 

Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 1, 3, 5, 7-11, 14-18, 36-38 and 40-45 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Carr (US Pat App Pub No 2003/0133043) in view of Kuzma 
(US Pat No 5,889,950) further in view of the ATVEF specification and further in view 



of Keronen et al. (US Pat No 6,567,530). 
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In regard to claim 1 , the Garr reference discloses a method and apparatus of 
communicating audio/video programs with enhancement data. The claimed step of 
obtaining a schema document, the schema document comprising a trigger data 
structure an announcement data structure, and a package data structure defining 
enhanced programming content is met by the content creator 12 providing 
enhancement data to transport operator 14 (Figure 1). The enhancement data provided 
by the content creator 12 includes "an ATVEF announcement, a resource, and a trigger" 
(Paragraph 0020, Lines 3-4). The enhancement data includes synchronization 
information (Paragraph 0013). The announcement data meets the limitation of a 
package data structure. "An announcement may describe the location of both the 
resource stream and the trigger stream" (Para 0021 , Lines 5-6). The claimed step for a 
timeline data structure regarding timing for the delivery of enhanced programming 
content is met by storage medium 113 and the controller 106 (Figure 2). The 
enhancement data is stored in storage medium 1 1 3 and is "accessed" by the controller 
106. "The controller 106 may be run under control of a software routine 108 (referred to 
as a transport routine). The transport routine 108 may initially be stored in a storage 
medium 104 and loaded by the controller 106 for execution. Instructions and data of the 
transport routine 108 may also be stored in the storage medium 104" (Paragraph 0034, 
Lines 12-17). "The enhancement data and special announcements may be stored in a 
storage medium 113" (Paragraph 0034, Lines 23-25). The enhancement data stored 
includes an ATVEF announcement, which provides the instruction for delivery of the 
enhanced programming content. "The controller 1 06 detects presence of 



Application/Control Number: 09/734,973 Page 5 

Art Unit: 2623 

announcements when they appear at the ATVEF announcement address and port in 
the transport operator system 14. The announcements are separated out onto different 
IP addresses corresponding to the AA/ channels, with one IP address assigned for the 
one or more ATVEF announcements associated with each AN channel" (Paragraph 
0038, Lines 12-19). The enhancement data is stored in storage medium 113 and is 
"accessed" by the controller 106, where the enhancement data includes synchronization 
information. The examiner interprets synchronization information to be timeline data. 
The enhanced programming content includes the trigger data structure, announcement 
data structure, package data structure and timeline data structure (As discussed 
earlier, Carr teaches the enhancement data includes an ATVEF announcement 
(package data), a resource, trigger, and synchronization information (timeline data) - 
[0020], [0021], [0013], [0034], [0038]). The reference fails to explicitly disclose the 
claimed step of the timeline data structure specifying specific times relative to a specific 
start time and a particular order for delivering each of the trigger, announcement and 
package data structures to the receiver. The reference also fails to explicitly disclose 
the step analyzing the timeline data structure to determine when to deliver each of the 
trigger, announcement and package data structures. Kuzma teaches a schema 
document that is generic and non-specific to hardware that comprises a timeline data 
structure specifying specific times relative to a specific start time and a particular order 
for delivering each of the trigger, announcement and package data structures to the 
receiver and analyzing the timeline data structure to determine when to deliver each of 
the trigger, announcement and package data structures so as to synchronize the 
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enhanced content with the video in real time (Figures 3-6, Co 2, Lines 38-54; Col 5, Line 
63-Col 7, Lines 14). Consequently, it would have been obvious to one of ordinary skill 
in the art to implement Carr with a schema document that is generic and non-specific to 
hardware that comprises a timeline data structure specifying specific times relative to a 
specific start time and a particular order for delivering each of the trigger, 
announcement and package data structures to the receiver and analyzing the timeline 
data structure to determine when to deliver each of the trigger, announcement and 
package data structures for the stated advantage. The combination of Carr and Kuzma 
fails to explicitly disclose the timeline including a loop attribute to prevent multiple 
deliveries of the enhanced programming content to the receiver. The ATVEF 
specification teaches a loop attribute to prevent multiple deliveries of the enhanced 
programming content to the receiver. The ATVEF specification discloses with respect 
to the parameter RetransmitExpiration: "This allow a resource to be carouseled, or sent 
repeatedly to increase the chances of delivery without missing segments. Set to zero if 
the resource will not be retransmitted" (Page 22). Consequently, it would have been 
obvious to one of ordinary skill in the art to the combined teaching with a loop attribute 
to prevent multiple deliveries of the enhanced programming content to the receiver so 
as to conform to the ATVEF specification. The combination of Carr and Kuzma and the 
ATVEF specification fail to explicitly disclose the step of verifying the authenticity of the 
schema document by comparing the schema document against a stored standardized 
schema document. Keronen teaches verifying the authenticity of a document by 
comparing the document by comparing a document against a stored standardized 
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document so as to ensure that a document is of proper form (Col 2, Lines 22-27). 
Consequently, it would have been obvious to one of ordinary skill in the art to implement 
the combined teaching with verifying the authenticity of a document by comparing the 
schema document by comparing a document against a stored standardized document 
so as to ensure that a document is of proper form. 

In regard to claim 3, the claimed step for accessing the schema document 
comprises the step of retrieving the schema document from a repository containing a 
plurality of schema documents is met by storage medium 113 and the controller 106 
(Figure 2 of Carr). The enhancement data is stored in storage medium 113 and is 
"accessed" by the controller 106. "The controller 106 may be run under control of a 
software routine 108 (referred to as a transport routine). The transport routine 108 may 
initially be stored in a storage medium 104 and loaded by the controller 106 for 
execution. Instructions and data of the transport routine 108 may also be stored in the 
storage medium 104" (Paragraph 0034, Lines 12-17). "The enhancement data and 
special announcements may be stored in a storage medium 113" (Paragraph 0034, 
Lines 23-25). The enhancement data stored includes an ATVEF announcement, which 
provides the instruction for delivery of the enhanced programming content. "The 
controller 106 detects presence of announcements when they appear at the ATVEF 
announcement address and port in the transport operator system 14. The 
announcements are separated out onto different IP addresses corresponding to the AN 
channels, with one IP address assigned for the one or more ATVEF announcements 
associated with each AA/ channel" (Paragraph 0038, Lines 12-19). 
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In regard to claim 5, the claimed limitation of the enhanced programming content 
comprising at least one of an announcement element, a trigger element, and a package 
element is met by the content creator 12 providing enhancement data to transport 
operator 14 (Figure 1 of Carr). The enhancement data provided by the content creator 
12 includes "an ATVEF announcement, a resource, and a trigger" (Paragraph 0020, 
Lines 3-4). The enhancement data includes synchronization information (Paragraph 
0013). The examiner interprets the resource to be the package element. 

In regard to claim 7, the claimed step of synchronizing the enhanced 
programming content with the television programming is met by "a trigger synchronizes 
the enhancement data with the TV transmission" (Paragraph 0021 of Carr). 

In regard to claim 8, the reference discloses that the enhancement data is 
delivered with a communications protocol. "The three components may be transmitted 
using Internet Protocol (IP) multicast to the receivers" (Paragraph 0021 of Carr). 

In regard to claim 9, the Carr reference discloses two types of protocols which 
met the limitations for transport A protocol and transport B protocol. "The three 
components may be transmitted using Internet Protocol (IP) multicast to the receivers. 
An IP multicast standard is described in Request for Comment (RFC) 1 301 , entitled 
"Multicast Transport Protocol." RFCs may be available at website address 
[http://www.ietf.org/rfc.html]" (Paragraph 0020, Lines 4-8). And, the "ATVEF 
Specification may utilize a one-way transmission protocol (the Unidirectional Hypertext 
Transfer Protocol or UHTTP, described in the ATVEF Specification) to deliver resource 
data" (Paragraph 0021, Lines 9-12). 



Application/Control Number: 09/734,973 Page 9 

Art Unit: 2623 

In regard to claim 10, the Carr reference discloses a method and apparatus of 
communicating audio/video programs with enhancement data. The reference fails to 
explicitly disclose delivering the enhanced programming content before a deliver-by 
time. However, it is submitted that it would have been clearly obvious to one of ordinary 
skill in the art at the time of the invention to implement the Carr system with delivering 
the enhanced programming content before a deliver-by time so as to ensure that the 
receiver system receives the enhanced programming data necessary for an interactive 
viewing experience. 

In regard to claim 1 1 , the Carr reference discloses a method and apparatus of 
communicating audio/video programs with enhancement data. The reference fails to 
explicitly disclose delivering the enhanced programming content by a start time. 
However, it is submitted that it would have been clearly obvious to one of ordinary skill 
in the art at the time of the invention to implement the Carr system with delivering the 
enhanced programming content by a start time so as to allow the receiver system to be 
interactive. 

In regard to claim 14, the claimed step for delivering an announcement signal 
comprising the announcement data structure to the receiver, the announcement signal 
identifying tile availability of enhanced programming content to the receiver is met by 
the ATVEF announcement. "Generally, an ATVEF announcement indicates that 
enhancement data is being transmitted, a resource includes one or more files that 
contain the enhancement data" (Paragraph 0021, Lines 1-3 of Carr). The steps of 
delivering a package comprising the package data, delivering a trigger signal 
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comprising the trigger data structure and in response to a selection by the viewer to 
receive the enhanced programming content, a step for displaying the enhanced 
programming content to the viewer is met by: "Generally, an ATVEF announcement 
indicates that enhancement data is being transmitted, a resource includes one or more 
files that contain the enhancement data, and a trigger synchronizes the enhancement 
data with the TV transmission. An announcement may describe the location of both the 
resource stream and the trigger stream. For each television (TV) channel, one or more 
enhancements may be offered as choices presented to the user, who can select which 
of the enhancements, if any, to view" (Paragraph 0021, Lines 1-9 of Carr). 

In regard to claim 15, the "package" may include at least one file containing 
enhanced programming content. "Enhancement data may include graphics (e.g., web 
pages, multimedia information, or other digital data files), presentation layout" 
(Paragraph 001 3, Lines 1 3-1 5 of Carr). 

In regard to claim 16, the "package" may include at least one link to enhanced 
programming content. "Enhancement data may include graphics (e.g., web pages, 
multimedia information, or other digital data files), presentation layout" (Paragraph 0013, 
Lines 13-15 of Carr). 

In regard to claim 17, the aforementioned combined teaching discloses a method 
and apparatus of communicating audio/video programs with enhancement data. The 
reference fails to explicitly disclose the trigger comprising a link to enhanced 
programming content. However, the examiner gives OFFICIAL NOTICE that it is 
notoriously well known that a trigger comprises a link to enhanced programming content 
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so as to announce the availability of the interactive television experience to the user. 
Consequently, it would have been clearly obvious to one of ordinary skill in the art to 
implement the combined teaching with a trigger that comprises a link to enhanced 
programming content so as to announce the availability of the interactive television 
experience to the user. 

In regard to claim 18, the step of accepting a notification displayed to the viewer 
of the availability of enhanced programming content is disclosed. "For each television 
(TV) channel, one or more enhancements may be offered as choices presented to the 
user, who can select which of the enhancements, if any, to view" (Paragraph 0021 , 
Lines 7-9 of Carr). 

In regard to claims 36-37, Carr discloses the communications line comprises a 
plurality of different channels. "To provide for greater flexibility and/or to alleviate 
bandwidth concerns of the transport medium 22, some embodiments of the invention 
transmit (using IP multicast) enhancement data associated with multiple AA/ channels 
(e.g., TV channels) over a link that is separate from the transport medium used to 
transmit AA/ content (or, alternatively, that is part of the same delivery mechanism as 
the A/V content but is not associated with any A/V channel, e.g., an MPEG-2 transport 
stream with ancillary information in a data-only program separate from the A/V 
programs)" (Paragraph 0025, Lines 1-10 of Carr). 

In regard to claim 38, the Carr reference discloses a method and apparatus of 
communicating audio/video programs with enhancement data. The Carr reference 
discloses that method may be implemented with a computer readable medium carrying 
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computer-executable instruction. "The software or firmware can be loaded into the 
information delivery system in one of many different ways. For example, instructions or 
other code segments stored on one or more storage media or transported through a 
network interface card, modem, or other interface mechanism may be loaded into the 
system 10 and executed to perform programmed acts. In the loading or transport 
process, data signals that are embodied as carrier waves (transmitted over telephone 
lines, network lines, wireless links, cables and the like) may communicate the 
instructions or code segments to the information delivery system" (Paragraph 0053 of 
Carr). 

In regard to claim 40, the aforementioned combined teaching discloses a method 
and apparatus of communicating audio/video programs with enhancement data. The 
combined teaching fails to explicitly disclose using a tag to validate the authenticity of 
the document. However, the examiner gives OFFICIAL NOTICE that it is notoriously 
well known to use tag for identification purposes so as to ensure correct receipt of 
information. Consequently, it would have been clearly obvious to one of ordinary skill in 
the art to implement the combined teaching with the use of tags for identification 
purposes so as to ensure correct receipt of information. 

In regard to claim 41 , the time stamp is a deliver by time for the enhancement 

data. 

In regard to claim 42, the time stamp indicated an order with respect to time for 
deliver. 



Application/Control Number: 09/734,973 Page 13 

Art Unit: 2623 

In regard to claim 43, the aforementioned combined teaching fails to explicitly 
disclose that the timeline data structure is zeroed at the beginning of the programming. 
However, it is submitted that it would have been clearly obvious to one of ordinary skill 
in the art torn implement the aforementioned combined teaching with a timeline data 
structure that is zeroed at the beginning of the programming so a to provide a time 
reference that is relative to the programming. 

In regard to claim 44, video inherently has as specific number of frames per unit 
of time (e.g. 30 frames/second). By specifying time, a number of frames are also 
specified. 

In regard to claim 45, the aforementioned combined teaching fails to explicitly 
disclose providing enhancement content via email, separate from the a/v programming. 
However, the examiner gives OFFICIAL NOTICE that it is notoriously well known to 
provide enhancement content via email, separate from the a/v programming so as to 
allow the user to user their PC to perform tasks with the enhancement content that are 
not associated with the programming receiver, thereby increasing system functionality. 
Consequently, it would have been clearly obvious to one of ordinary skill in the art to 
implement the combined teaching with providing enhancement content via email, 
separate from the a/v programming for the stated advantage. 
1. Claims 2, 4, and 30 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Carr in view of Kuzma further jn view of the ATVEF specification and further in 
view of Keronen et al. and further in view of Valdez Jr. (US Pat No 6,426,778). 
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In regard to claim 2, the aforementioned combined teaching of claim 1 fails to 
explicitly disclose a step for viewing television programming deliverable to the receiver 
and in response to viewing the television programming, a step for creating the schema 
document associated with the television programming. The Valdez Jr. reference 
teaches viewing television programming deliverable to the receiver so as to facilitate the 
editing of the "compositions" or enhance content and in response to viewing the 
television programming creating the schema document associated with the television 
programming so as to enhance the viewing pleasure of the television viewer. "Media 
playback 31 1 provides a facility for playing back compositions locally at the playback 
system or may transmit a composition as video transmission 321 and data transmission 
323" (Col 8, Lines 36-40). And, "to support editing of compositions of such a variety of 
media, a media editing system 309 is provided that may create data structures for 
organizing and storing information regarding a composition and perform operations for 
manipulating these data structures" (Col 8, Lines 22-26). Consequently, it would have 
been obvious to one of ordinary skill in the art to implement the combined teaching with 
viewing television programming deliverable to the receiver so as to facilitate the editing 
of the "compositions" or enhance content and in response to viewing the television 
programming creating the schema document associated with the television 
programming so as to enhance the viewing pleasure of the television viewer. 

In regard to claim 4, the combined teachings of Carr and Kuzma fails to explicitly 
disclose the step for creating the schema document comprises a step for creating the 
schema document with an authoring tool. The Valdez Jr. reference teaches a graphical 
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user interface with an enhanced program editing system so to increase the ease of use 
for the operator. Consequently, it would have been obvious to one of ordinary skill in 
the art to implement the combined teaching with the step for creating the schema 
document comprises a step for creating the schema document with an authoring tool for 
the stated advantage. 

In regard to claim 30, the aforementioned combined teaching of claim 1 fails to 
explicitly disclose the use of XML. The Valdez Jr. reference teaches the use of XML so 
as to represent a wide variety of document types. Consequently, it would have been 
obvious to one of ordinary skill in the art to implement the combined teaching with the 
use of XML for the stated advantage. 

2. Claims 6 and 12-13 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Carr in view of Kuzma further in view of the ATVEF specification and further in 
view of Keronen et al. and further in view of Goodman et al. (US Pat No 6,427,238). 

In regard to claim 6, the aforementioned combined teaching of claim 1 fails to 
explicitly disclose delivering the enhanced programming content in an order selected 
from the group consisting of a sequential order and an asynchronous order. This 
claimed step is interpreted by the examiner as being written in the alternative, such that 
the claimed limitation may be met by delivering the enhanced programming content in a 
"sequential order" or "an asynchronous order." The Goodman et al. reference teaches a 
timeline data structure that functions as the carousel data structure where the data 
modules are in sequential order (Figure 3) so as to provide a cyclic time-structured 
method of providing enhanced programming to the viewer. Consequently, it would have 
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been obvious to one of ordinary skill in the art to implement the combined teaching with 
a timeline data structure that functions as the carousel data structure so as to provide a 
sequentially cyclic time-structured method of providing enhanced programming to the 
viewer. 

In regard to claim 12, the aforementioned combined teaching of claim 1 fails to 
explicitly disclose a timeline data structure that functions as the carousel data structure. 
The Goodman et al. reference teaches a timeline data structure that functions as the 
carousel data structure so as to provide a cyclic time-structured method of providing 
enhanced programming to the viewer. Consequently, it would have been obvious to one 
of ordinary skill in the art to implement the combined teaching with a timeline data 
structure that functions as the carousel data structure so as to provide a cyclic time- 
structured method of providing enhanced programming to the viewer. 

In regard to claim 13, the aforementioned combined teaching of claim 1 fails to 
explicitly disclose a carousel data structure functions as the timeline data structure. The 
Goodman et al. reference teaches a carousel data structure that functions as the 
timeline data structure so as to provide a cyclic time-structured method of providing 
enhanced programming to the viewer. Consequently, it would have been obvious to one 
of ordinary skill in the art to implement the combined teaching with a timeline data 
structure that functions as the carousel data structure so as to provide a cyclic time- 
structured method of providing enhanced programming to the viewer. The trigger data 
structure, the announcement data structure, and the package data structure being 
delivered as fast as possible is implicit to the reference. Assuming arguendo with 
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respect to the implicit teaching of the trigger data structure, the announcement data 
structure, and the package data structure being delivered as fast as possible, it is 
submitted that it would have been clearly obvious to one of ordinary skill in the art at the 
time of the invention to implement the combined teaching with transmitting 
enhancement data as fast as possible so as to advantageously provide the user with 
real-time interactive programming. 

Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Sumaiya A. Chowdhury whose telephone number is 
(571) 272-8567. The examiner can normally be reached on Mon-Fri, 9-5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examinees 
supervisor, Chris Grant can be reached on (571) 272-7292. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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